Image processing apparatus and method

ABSTRACT

The present disclosure relates to an image processing apparatus and method that enables to correctly obtain an area of a main object at the time of auto focusing. 
     A control block selects a local focus area from information of a taken image and supplies designated focus position information indicative of the selected local focus area to an image processing block. The image processing block executes a control operation related with focusing on the basis of object area information indicative of an area corresponding to two or more objects within an image and designated focus position information indicative of a designated focus position in this image. The present disclosure is applicable to an imaging apparatus, for example.

TECHNICAL FIELD

The present disclosure relates to an image processing apparatus and animage processing method and, more particularly, to an image processingapparatus and an image processing method that are configured tocorrectly obtain a main object area in auto focusing.

BACKGROUND ART

For a technology of automatic focusing of cameras (an autofocus function(AF)), a technique is known in which focus bracket imaging is executedon the basis of focus evaluation values (refer to Patent Literature 1below).

CITATION LIST Patent Literature [PTL 1]

JP 2009-86030A

SUMMARY Technical Problem

However, technologies that allow the correct focusing on the object ofimage taking intended by image-taking person under more variable imagingconditions are desired.

Therefore, in consideration of the situations mentioned above, thepresent disclosure provides more correct auto focusing.

Solutions to Problem

In carrying out the present disclosure and according to one aspectthereof, there is provided an image processing apparatus. This imageprocessing apparatus includes an image processing block configured tocontrol related with focusing on the basis of object area informationindicative of an area corresponding to a plurality of objects in animage and designated focus position information indicative of adesignated focus position in the image.

The plurality of objects may include a main object and a background.

The plurality of objects may include at least two similar objects.

The image processing block may execute processing of estimating abackground area as the processing related with focusing.

The image processing block may identify the designated focus position asthe processing related with focusing.

If the designated focus position is positioned in a background area, theimage processing block may correct the designated focus position to bean area of a main object among the plurality of objects as theprocessing related with focusing.

The image processing block may generate an object frame that encloses anarea of the designated focus position as the processing related withfocusing.

This image processing apparatus may further include an area partitionblock configured to partition an input image into areas related with theplurality of objects on the basis of color boundary.

The object area information is indicative of an area related with theplurality of objects in the image partitioned by color boundary.

The designated focus position information is indicative of a position ofa point included in a local focus area selected in the image.

In carrying out the present disclosure and according to another aspectthereof, there is provided an image processing method. This imageprocessing method includes executing, by an image processing apparatus,processing related with focusing on the basis of object area informationindicative of an area corresponding to a plurality of objects in animage and designated focus position information indicative of adesignated focus position in the image.

In one aspect of the present disclosure, processing related withfocusing is executed on the basis of object area information indicativeof an area corresponding to a plurality of objects in an image anddesignated focus position information indicative of a designated focusposition in the image.

Advantageous Effect of Invention

According to one aspect of the present disclosure, a main object areacan be correctly obtained especially in auto focusing.

It should be noted that the effect described herein are illustrativeonly and therefore not restricted thereto; namely, there may beadditional advantageous effects.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating an example of a configuration ofan imaging apparatus to which the present technologies is applied.

FIG. 2 is a block diagram illustrating an example of a configuration offunctional blocks that are executed by an image processing block.

FIG. 3 is a block diagram illustrating an example of a configuration ofan object frame generation block.

FIG. 4 is a diagram for describing the processing of a SuperPixelgeneration block.

FIG. 5 is a diagram for describing the processing of the object framegeneration block.

FIG. 6 is a diagram for describing the correction of a starting point.

FIG. 7A through 7D are diagrams for describing the object reliability ofa SuperPixel to be processed.

FIG. 8 is a flowchart indicative of the imaging processing by theimaging apparatus to which present technology is applied.

FIG. 9 is a flowchart indicative of the processing to be executed on afirst frame.

FIG. 10 is a flowchart indicative of object frame generation processing.

FIG. 11 is a flowchart indicative of the processing to be executed onthe second and subsequent frames.

FIG. 12 is a diagram illustrating effect of the present technology.

FIG. 13 is a diagram illustrating an object frame image generated by arelated-art method for the description of effect of the presenttechnology.

FIG. 14 is a diagram illustrating the effect of the present technology.

FIG. 15 is a diagram illustrating an object frame image generated by arelated-art method for the description of the effect of the presenttechnology.

FIG. 16 is a block diagram illustrating an example of a mainconfiguration of a personal computer.

DESCRIPTION OF EMBODIMENTS

The following describes modes (hereafter referred to as embodiments) forpracticing the present disclosure.

Imaging Apparatus based on Present Technology Now, FIG. 1 is a blockdiagram illustrating a configuration of an example of an imagingapparatus to which the present technology is applied.

The imaging apparatus 10 depicted in FIG. 1 includes a lens unit 100, animaging device 101, an image processing block 102, a control block 103,a display block 104, a memory 105, a recording device 106, amanipulation block 107, a sensor block 108, and a bus 109.

The lens unit 100 condenses a light image of an object to be taken. Thelens unit 100 has a mechanism to adjust a focus lens and apertures onthe basis of an instruction from the control block 103 so as to obtain aproper image.

The imaging device 101 photoelectrically converts a light imagecondensed by the lens unit 100 into an electrical signal. To bespecific, the imaging device 101 is realized by a CCD (Charge CoupledDevice) image sensor or a CMOS (Complementary Metal Oxide Semiconductor)image sensor, for example.

The image processing block 102, the control block 103, the display block104, the memory 105, the recording device 106, the manipulation block107, and the sensor block 108 are interconnected by the bus 109.

The image processing block 102 includes a sampling circuit for samplingan electrical signal received from the imaging device 101, ananalog-to-digital (A/D) conversion circuit for converting an analogsignal into a digital signal, an image processing circuit for executingpredetermined image processing on a digital signal, and the like. Theimage processing block 102 has not only dedicated hardware circuits butalso a CPU (Central Processing Unit) and a DSP (Digital SignalProcessor), thereby executing software processing in order to handleflexible image processing.

Especially, the image processing block 102 divides an image into areasand, on the basis of the information about local focus area receivedfrom the control block 103, executes focusing-related processing (suchprocessing as background estimation, starting point correction, areacoupling, and object frame generation). It should be noted that thedetail of the processing to be executed by the image processing block102 will be described later.

The control block 103 includes a CPU (Central Processing Unit) and acontrol program and controls each of the blocks of the image processingapparatus. The control program itself is actually stored in the memory105 and is executed by the CPU. Especially, the control block 103selects a local focus area from taken image information and drives afocus lens of the lens unit 100 on the basis of a focus target position(depth) in the selected local focus area and a focus position (depth) ofthe lens unit 100. Further, the control block 103 supplies designatedfocus position information indicative of the selected local focus areato the image processing block 102.

The display block 104 includes a D/A conversion circuit for convertingan image signal processed by the image processing block 102 and storedin the memory 105 into an analog signal, a video encoder for encodingthe analog video signal into a video signal having format compatiblewith a display apparatus in a subsequent stage, and a display apparatusfor displaying an image corresponding to the entered video signal. Thedisplay apparatus is realized by an LCD (Liquid Crystal Display) and thelike, for example, and also functions as a finder.

The memory 105 includes a semiconductor memory such as a DRAM (DynamicRandom Access Memory) in which image data processed by the imageprocessing block 102, a control program in the control block 103, andvarious kinds of data are stored in a temporary manner.

The recording device 106 includes a semiconductor memory such as a flashmemory, a magnetic disc, an optical disc, a magneto-optical disc or thelike. At the time of imaging, a taken image is encoded by the imageprocessing block 102 into JPEG (Joint Photographic Experts Group) formatand stored in the memory 105 to be recorded to a recording medium. Atthe time of reproduction, the JPEG image is read from the recordingmedium into the memory 105 to be decoded by the image processing block102.

The manipulation block 107 includes input devices such as a hardware keylike a shutter button, a manipulation dial, and a touch panel anddetects an input manipulation by an image-taking person, an operation ofthe image processing apparatus being determined by a control operationby the control block 103.

The sensor block 108 includes a gyro sensor, an acceleration sensor, ageomagnetic sensor, a GPS (Global Positioning System) sensor, forexample, thereby detecting various kinds of information. These pieces ofinformation are added to the taken image data as metadata and, at thesame time, used for various kinds of image processing and controlprocessing.

FIG. 2 is a block diagram illustrating an example of a configuration offunctional blocks that are executed by the image processing block 102.

The functional block depicted in FIG. 2 includes a SuperPixel generationblock 121 and an object frame generation block 122. Finger and staricons in the example depicted in FIG. 2 are indicative of an initialpoint (starting point) S that is entered as designated focus positioninformation indicative of a local focus area received from the controlblock 103 and included in this local focus area. The initial pointincludes a point at approximate the center of a local focus area, forexample. It should be noted that a local focus area may be a focuspoint. Therefore, designated focus position information may be theposition information of a local focus area or the position informationof that initial point.

An input image 131 is entered in the SuperPixel generation block 121from the imaging device 101. The SuperPixel generation block 121executes SuperPixel generation processing. That is, the SuperPixelgeneration block 121 explicitly area-partitions the input image 131 bycolor boundary so as to generate an intermediately processed image (aSuperPixel image) 132 by use of a SuperPixel generation technology. TheSuperPixel generation block 121 outputs the generated intermediatelyprocessed image 132 to the object frame generation block 122.

It should be noted that, generally, at the boundaries of an object,there are frequently different colors. Therefore, in the intermediatelyprocessed image 132 that is generated by the SuperPixel generationprocessing that groups pixels by color, an area of colors related with amain object may be an area of an object different from an area ofsimilar colors of colors related with the main object. That is, it canbe said that the intermediately processed image 132 is partitioned intoareas related with two or more objects by the SuperPixel generationprocessing and has object area information indicative of areas relatedwith two or more objects.

The designated focus position information indicative of the initialpoint (starting point) S included in a local focus area is entered intothe object frame generation block 122 from the control block 103. Theobject frame generation block 122 enters the intermediately processedimage 132 having object area information and, on the basis of thedesignated focus position information indicative of the starting point Sand the entered object area information, executes the processing relatedwith focusing (such processing as background estimation, starting pointcorrection, area coupling, and object frame generation), therebyoutputting an image (referred to as an object frame image) 133indicative of an object frame F to the display block 104, for example.In response, the display block 104 displays the image 133 indicative ofthe object frame F.

In addition, the object frame generation block 122 may supply theinformation about a corrected starting point or the information aboutthe starting point with correction not required to the control block 103as the designated focus position information. At this moment, thecontrol block 103 drives the focus lens of the lens unit 100 by a focustarget position (depth) based on the designated focus positioninformation received from the object frame generation block 122.

FIG. 3 is a block diagram illustrating an example of a configuration ofan object frame generation block.

In the example depicted in FIG. 3, the object frame generation block 122includes a background estimation block 141, a starting point correctionblock 142, a SuperPixel coupling block 143, and a candidate framegeneration block 144.

As described above, a background estimation image 151 is partitionedinto areas of two or more objects. The two or more objects may includetwo or more objects that are similar to each other. Further, the two ormore objects include a main object that is to be focused and abackground. The background estimation block 141 estimates a backgroundarea from areas of two or more objects in the intermediately processedimage 132 and supplies the background estimation image 151 (thecross-hatched area provides the background section) that is an imagewith the background estimated to the starting point correction block142.

The starting point correction block 142 identifies an area in which thestarting point S is positioned in the background estimation image 151and, if the identified area is the background area, corrects thestarting point S on the main object in object reliability. The startingpoint correction block 142 supplies a starting point corrected image 152that is an image ended with starting point correction to the SuperPixelcoupling block 143.

The SuperPixel coupling block 143 couples SuperPixels that are near eachother in color distance or space distance and supplies an image withSuperPixels coupled to the candidate frame generation block 144. Thecandidate frame generation block 144 generates a candidate frame thatencloses an area in which the starting point S is positioned, namely,the SuperPixel of a main object is included and outputs the generatedcandidate frame as an object frame F.

FIG. 4 is a diagram for describing the processing to be executed by theSuperPixel generation block.

The SuperPixel generation block 121 generates a SuperPixel (pixel group)by grouping similar colors by use of a threshold value for the inputimage 131 and outputs an image with two or more SuperPixels generated,namely, the area-partitioned intermediately processed image 132 to theobject frame generation block 122.

FIG. 5 is a diagram for describing the processing to be executed by theobject frame generation block.

In the intermediately processed image 132, the background estimationblock 141 checks the number of image end pixels of SuperPixels andchecks the size and shape of SuperPixels so as to estimate a backgroundarea from two or more object areas, thereby outputting the backgroundestimation image 151 with a background estimated to the starting pointcorrection block 142.

If the starting point S is positioned in an area, which is a backgroundof the background estimation image 151, the starting point correctionblock 142 obtains an object reliability indicative of a degree ofreliability of an object for each SuperPixel and corrects the startingpoint S in accordance with the obtained object reliability.

In the background estimation image 151 with the starting point Scorrected as required, the SuperPixel coupling block 143 couples theSuperPixels that are near each other in color distance or space distanceand supplies the image with the SuperPixels coupled to the candidateframe generation block 144.

FIG. 6 is a diagram for describing the correction of a starting point.

As depicted in FIG. 6, if the starting point S (the star mark in thediagram) is positioned at a SuperPixel estimated as a background, thestarting point correction block 142 makes the starting point S jump to aSuperPixel other than the background and then corrects the startingpoint.

For example, in a background estimation image 151A, since the startingpoint S is found at a SuperPixel estimated to be a background(cross-hatched section), the starting point S is moved to SuperPixels(1, 2, and 3) other than background as depicted in background images151B through 151D. This movement is executed in accordance with anobject reliability described next.

FIG. 7 are diagrams for describing the object reliability of aSuperPixel to be processed. In the example depicted in FIG. 7, S isindicative of the starting point and the SuperPixel to be processed isindicated by an object frame F. It should be noted that in A of FIG. 7,except for a dog at center and gravestones is a background area. In B ofFIG. 7, except for a dog at center and a window fence above the dog is abackground area. In C of FIG. 7, except for a dog and a car is abackground area. In D of FIG. 7, except for a dog is a background area.

When the starting point is in the SuperPixel of a background area, thestarting point correction block 142 selects a SuperPixel to be processedfrom the following factors.

A: As depicted in A of FIG. 7, a SuperPixel with the space distancebeing near from the starting point is regarded as being high in mainobject reliability.

B: As depicted in B of FIG. 7, a SuperPixel with the space distancebeing near from a focus area center (the center of the image here) isregarded as being high in main object reliability.

C: As depicted in C of FIG. 7, a SuperPixel with color distance beingaway from background is preferable.

C-1: A SuperPixel with the color distance separated away from theSuperPixel (regarded as background) in which the starting point existsis regarded to be high in main object reliability.

C-2: A SuperPixel with the color distance separated away from themaximum size of SuperPixel in the background area is regarded as beinghigh in main subject reliability.

D: As depicted in D of FIG. 7, a SuperPixel having a large area isregarded to be high in main object reliability.

On the basis of at least one or a combination of the above-mentionedfactors, the SuperPixel to be processed is selected.

The following describes the imaging processing to be executed by theimaging apparatus 10 depicted in FIG. 1 with reference to a flowchartdepicted in FIG. 8.

In step S11, if the control block 103 of the imaging apparatus 10 waitsuntil a shutter button making up the manipulation block 107 is halfpressed and, upon determination that the shutter button has been halfpressed, the processing goes to step S12.

In step S12, the image processing block 102 and the control block 103execute the processing on the first frame. This processing captures anobject in accordance with a local focus area, which will be describedlater with reference to FIG. 9.

In step S13, the image processing block 102 and the control block 103execute the processing on the second and subsequent frames. Thisprocessing traces an object, which will be described later withreference to FIG. 11.

An object frame F is displayed by the processing in steps S12 and S13and the shutter button is fully pressed, so that the control block 103controls the imaging device 101 so as to take photograph in step S14.The imaging device 101 photoelectrically converts an optical imagecondensed through the lens unit 100 into an electrical signal. The imageprocessing block 102 samples the electrical signal received from theimaging device 101 and converts the sampled electrical signal intodigital image data, thereby executing predetermined image processing.

In step S15, the image processing block 102 stores the image data intothe memory 105.

The following describes the processing to be executed on the first framein step S12 depicted in FIG. 8 with reference to FIG. 9. It should benoted that the processing of capturing an object is executed in theexample depicted in FIG. 9.

When the shutter button is half pressed in step S11 depicted in FIG. 8,the information thereof is entered from the manipulation block 107 intothe control block 103 and the image processing block 102. In addition,the input image 131 at that moment is entered from the imaging device101 into the control block 103 and the image processing block 102.

In step S31, the control block 103 selects a local focus area from theinput image 131. The designated focus position information indicative ofthe selected local focus area is supplied to the object frame generationblock 122.

In step S32, the control block 103 computes an offset between a focustarget position (depth) in the local focus area and a lens focusposition (depth) on the basis of the designated focus positioninformation. In step S33, the control block 103 drives the focus lens ofthe lens unit 100 on the basis of the offset computed in step S32.

On the other hand, in step S34, by use of a SuperPixel generationtechnology, the SuperPixel generation block 121 explicitlyarea-partitions the input image 131 entered from the input image 131 bycolor boundary so as to generate the intermediately processed image 132(SuperPixel image) that is area-partitioned (with respect to two or moreobjects). The SuperPixel generation block 121 outputs the generatedintermediately processed image 132 to the object frame generation block122.

In step S35, the object frame generation block 122 generates an objectframe F on the basis of the intermediately processed image 132 havingobject area information received from the SuperPixel generation block121 and the designated focus position information of the local focusarea (starting point) S received from the control block 103. This objectframe generation processing will be described later with reference toFIG. 10. The object frame image 133 generated in step S35 is displayedon the display block 104.

In step S36, a feature amount acquisition block (not depicted) of theimage processing block 102 acquires a feature amount of an object. Here,the acquired object feature amount and the designated focus positioninformation of a starting point are used in the processing for thesecond and subsequent frames.

Thus, an object is captured in accordance with a local focus area, anobject frame is generated, and the generated object frame is displayedon the display block 104.

The following describes the object frame generation processing to beexecuted in step S35 depicted in FIG. 9 with reference to a flowchartdepicted in FIG. 10.

In step S71, the background estimation block 141 estimates a backgroundfrom the areas of two or more objects in the intermediately processedimage 132 and supplies the background estimation image 151 (thecross-hatched section is the background section) that is the imageestimated with the background area to the starting point correctionblock 142.

In step S72, the starting point correction block 142 identifies an areain which the starting point S is positioned on the basis of thedesignated focus position information and determines, in the backgroundestimation image 151, whether or not the area in which the startingpoint S is positioned is a background. If the area in which the startingpoint S is positioned is found to be a background in step S72, then theprocessing goes to step S73.

In step S73, the starting point correction block 142 corrects thestarting point S on the basis of the main object reliability describedabove with reference to FIG. 7. The starting point correction block 142supplies the starting point corrected image 152 that is an image withstarting point corrected to the SuperPixel coupling block 143. It shouldbe noted that the object frame generation block 122 may be configuredsuch that the information about the corrected starting point or theinformation about the starting point not requiring correction issupplied to the control block 103 as designated focus positioninformation. At that moment, the control block 103 drives the focus lensof the lens unit 100 by a focus target position (depth) based on thedesignated focus position information received from the object framegeneration block 122. Then, the processing goes to step S74.

If it is determined in step S72 that the area in which the startingpoint S is positioned is not a background, then the processing of stepS73 is skipped and the processing goes to step S74.

In step S74, the SuperPixel coupling block 143 couplies the SuperPixelsthat are near to each other in color distance or a space distance andsupplies an image with the SuperPixels coupled to the candidate framegeneration block 144.

In step S75, the candidate frame generation block 144 generates acandidate frame enclosing an area in which the starting point S ispositioned, namely, the SuperPixel of the main object is included, andoutputs the generated candidate frame as an object frame F.

As described above, since area separation is executed on a colorboundary by use of a SuperPixel (area partition), objects having similarcolors can be recognized as different objects. Consequently, an objectframe can be correctly obtained. In addition, since the backgrounddetermination is executed on an area by area basis, a local focus areacan be corrected.

The following describes the processing to be executed on the second andsubsequent frames in step S13 depicted in FIG. 8 with reference to aflowchart depicted in FIG. 11. It should be noted that, in the exampledepicted in FIG. 11, the processing tracing an object is executed.

In step S91, a movement position estimation block (not depicted) of theimage processing block 102 estimates a movement position of an object.

In step S92, the control block 103 selects a local focus area on thebasis of the movement position of the object estimated in step S91. Instep S93, on the basis of the designated focus position informationindicating the local focus area, the control block 103 computes anoffset between a focus target position (depth) in the local focus areaand a lens focus position (depth). In step S94, the control block 103drives the focus lens of the lens unit 100 on the basis of the offsetcomputed in step S93.

In step S95, the control block 103 determines whether or not the shutterbutton has fully pressed. If the user fully presses the shutter button,the manipulation block 107 supplies the information thereof to thecontrol block 103. The control block 103 determines in step S95 that theshutter button has fully pressed and ends the processing on the secondand subsequent frames.

On the other hand, if it is determined in step S95 to that the shutterbutton has not fully pressed, then the processing is returned to stepS91 to repeat the processing therefrom.

Effect of Present Technology

The following describes the effect of the present technology withreference to FIG. 12 through FIG. 15.

With the present technology, areas can be explicitly separated on acolor boundary (a boundary of objects) by use of the area partitioning(SuperPixel generation) technology, so that the objects having similarcolors can be handled as different separate objects, thereby correctlyobtaining the objects to be imaged.

As depicted in FIG. 12, specifying a focus area (starting point) S onlyon an upper bird in the diagrams separates the area into two or moreobjects in the intermediately processed image 132 generated by the areapartition technology. Accordingly, as depicted in the object frame image133 the object frame F can be displayed so as to enclose only the upperbird in the diagrams. Therefore, as with the example depicted in FIG.13, for example, even if the focus area (starting point) S is specifiedonly on the upper bird in the diagrams, the object frame F can beprevented from resultantly enclosing the two birds, as depicted in theobject frame image 133.

In addition, every area is determined whether or not the area is thebackground; if the starting point S is the background in a local focusarea selection, then the focus area is corrected, so that an objecttargeted by an image-taking person can be captured even if the focusarea is erroneously shifted to the background.

As depicted in FIG. 14, even if the starting point S is set to thebackground in the input image 131, the background is indicated asdepicted in the background estimation image 151 and the starting point Sis corrected as depicted in starting point corrected image 152.Therefore, in the object frame image 133, the object frame F can bedisplayed so as to enclose the dog targeted by an image-taking person.For example, as depicted in FIG. 15, even if the starting point S is setto the background, the object frame F can be prevented from getting outof the background.

As described above and according to the present technology, areaseparation is realized by the color boundary by use of a SuperPixel(area partition), so that objects of similar colors can be recognized asdifferent objects, thereby allowing the focusing on an object targetedby an image-taking person. In addition, an object frame can be correctlyobtained.

Further, even if there occurs an offset between an object targeted by animage-taking person and a designated focus point because of hand shakingor movement of the object, the targeted object can be surely focused.

It should be noted that, the above description is explained that thecase of autofocus in which the initial point (starting point) of a localfocus area is determined from the information of a taken image. It isalso practicable to apply the present technology to the case in which auser specifies a focus position by execution button or touch panelmanipulation on a desired point or a desired area of a live view imagedisplayed on the display block 104, thereby determining the startingpoint.

In addition, user manipulation is not restricted to only buttonmanipulation and touch panel manipulation; for example, manipulationscan be accepted from other external manipulation devices (multi-functionportable terminals or multi-function mobile phones, for example,)through the communication block.

It should be noted that, in the above description, the processingoperations up to the generation of an object frame are described;however, the processing operations are not restricted to the generationof an object frame. The present technology is also applicable to thecase in which no object frame is displayed. For example, in the case ofa monitor camera, the present technology is applicable to taking out anarea for identifying a main object later.

Further, the present technology is applicable to image processingapparatuses, imaging apparatuses, monitor cameras, automobile cameras,and the like and video systems including these apparatuses and devices.

Personal Computer

The sequence of processing operations described above can be executed byhardware or software. In the execution of the sequence of processingoperations by software, the programs making up this software areinstalled on a computer. Here, the computer includes one that is builtin dedicated hardware or a general-purpose personal computer capable ofexecution various kinds of functions by installing various kinds ofprograms.

FIG. 16 is a block diagram illustrating an example of a configuration ofhardware of a personal computer that executes the above-mentionedsequence of processing operations by programs.

In a personal computer 500, a CPU (Central Processing Unit) 501, a ROM(Read Only Memory) 502, and a RAM (Random Access Memory) 503 areinterconnected through a bus 504.

The bus 504 is further connected to an input/output interface 505. Theinput/output interface 505 is connected to an input block 506, an outputblock 507, a storage block 508, a communication block 509, and a drive510.

The input block 605 includes a keyboard, a mouse, a microphone and soon. The output block 507 includes a display, a speaker, and so on. Thestorage block 508 includes a hard disc drive, a nonvolatile memory, andso on. The communication block 509 includes a network interface and soon. The drive 510 drives removable medium 511 such as a magnetic disc,an optical disc, a magneto-optical disc, a semiconductor memory, or thelike.

In the personal computer 500 configured as described above, the CPU 501loads programs from the storage block 508 into the RAM 503 through theinput/output interface 505 and the bus 504 so as to execute theprograms, for example. Consequently, the above-mentioned sequence ofprocessing operations is executed.

Programs to be executed by the computer (or the CPU 501) are provided asrecorded in the removable medium 511. The removable medium 511 is, forexample, package media and the like including a magnetic disc (includinga flexible disc), an optical disc (CD-ROM (Compact Disc Read-OnlyMemory), a DVD (Digital Versatile Disc), and the like), amagneto-optical disc, or a semiconductor memory. Alternatively, theprograms can be provided through wired or wireless transmission mediumsuch as local area networks, the Internet, or digital satellitebroadcasting.

In the computer, the programs can be installed into the storage block508 through the input/output interface 505 by loading the removablemedium 511 on the drive 510. In addition, the programs can be installedin the storage block 508 by receiving the programs through thecommunication block 509 via wired or wireless transmission medium.Otherwise, the programs can be installed in the ROM 502 or the storageblock 508 in advance.

It should be noted that the programs to be executed by the computer maybe executed in a time series along the sequence described herein, inparallel to each other, or on an as-demanded basis when it is called orthe like.

It should also be noted that, herein, the steps describing each of theprograms recorded to recording medium include not only the processingoperations to be executed in a time series along the sequence describedherein but also, even if not always executed in time series, theprocessing operations that are executed in parallel or individually.

It should be noted that, herein, a system denotes an entire apparatusconfigured by two or more devices (or apparatuses).

It should also be noted that the above-mentioned configuration describedas one apparatus (or one processing block) may be divided and resultanttwo or more apparatuses (or two or more processing blocks) may provide aconfiguration, and vice versa. Conversely, other configurations thandescribed above may obviously be added to the configuration of eachapparatus (or each processing block). In addition, if the configurationand operation as an entire system is substantially the same, a part ofthe configuration of a certain apparatus (or a certain processing block)may be included in the configuration of another apparatus (or anotherprocessing block). That is, the present technology is not restricted tothe embodiment described above and therefore various changes andvariations to the above-mentioned embodiment are practicable within thescope of the substance of the present technology.

While preferred embodiments of the present disclosure have beenspecifically described with reference to the drawings, the presentdisclosure is not limited to the embodiments described above. It isobvious that person with an ordinary skill in the art to which thedisclosure pertains can conceive various changes and modificationswithout departing from the spirit or scope of the following claims. Alsothese various changes and modifications may also fall within the scopeof the present disclosure.

It should be noted that the present technology can also take thefollowing configuration.

(1) An image processing apparatus including:

an image processing block configured to execute processing related withfocusing on the basis of object area information indicative of an areacorresponding to a plurality of objects in an image and designated focusposition information indicative of a designated focus position in theimage.

(2) The image processing apparatus according to (1) above, in which

the plurality of objects include a main object and a background.

(3) The image processing apparatus according to (1) above, in which

the plurality of objects include at least two similar objects.

(4) The image processing apparatus according to any one of (1) through(3) above, in which

the image processing block executes processing of estimating abackground area as the processing related with focusing.

(5) The image processing apparatus according to any one of (1) through(4) above, in which

the image processing block identifies the designated focus position asthe processing related with focusing.

(6) The image processing apparatus according to any one of (1) through(5) above, in which

if the designated focus position is positioned in a background area, theimage processing block corrects the designated focus area to be an areaof a main object among the plurality of objects as the processingrelated with focusing.

(7) The image processing apparatus according to any one of (1) through(6) above, in which

the image processing block generates an object frame that encloses anarea of the designated focus position as the processing related withfocusing.

(8) The image processing apparatus according to any one of (1) through(7) above, further including:

an area partition block configured to partition an input image intoareas related with the plurality of objects on the basis of colorboundary.

(9) The image processing apparatus according to any one of (1) through(8) above, in which

the object area information is indicative of an area related with theplurality of objects in the image partitioned by color boundary.

(10) The image processing apparatus according to any one of (1) through(9) above, in which

the designated focus position information is indicative of a position ofa point included in a local focus area selected in the image.

(11) An image processing method including:

executing, by an image processing apparatus, processing related withfocusing on the basis of object area information indicative of an areacorresponding to a plurality of objects in an image and designated focusposition information indicative of a designated focus position in theimage.

REFERENCE SIGNS LIST

10 . . . Imaging apparatus, 100 . . . Lens unit, 101 . . . Imagingdevice, 102 . . . Image processing block, 103 . . . Control block, 104 .. . Display block, 106 . . . Recording device, 107 . . . Manipulationblock, 121 . . . Superpixel generation block, 122 . . . Object framegeneration block, 131 . . . Input image, 132 . . . Intermediatelyprocessed image, 133 . . . Object frame image, 141 . . . Backgroundestimation block, 142 . . . Starting point correction block, 143 . . .Superpixel coupling block, 144 . . . Candidate frame generation block,151 . . . Background estimation image, 152 . . . Starting pointcorrected image

1. An image processing apparatus comprising: an image processing blockconfigured to execute processing related with focusing on the basis ofobject area information indicative of an area corresponding to aplurality of objects in an image and designated focus positioninformation indicative of a designated focus position in the image. 2.The image processing apparatus according to claim 1, wherein theplurality of objects include a main object and a background.
 3. Theimage processing apparatus according to claim 1, wherein the pluralityof objects include at least two similar objects.
 4. The image processingapparatus according to claim 1, wherein the image processing blockexecutes processing of estimating a background area as the processingrelated with focusing.
 5. The image processing apparatus according toclaim 1, wherein the image processing block identifies the designatedfocus position as the processing related with focusing.
 6. The imageprocessing apparatus according to claim 5, wherein if the designatedfocus position is positioned in a background area, the image processingblock corrects the designated focus area to be an area of a main objectamong the plurality of objects as the processing related with focusing.7. The image processing apparatus according to claim 5, wherein theimage processing block generates an object frame that encloses an areaof the designated focus position as the processing related withfocusing.
 8. The image processing apparatus according to claim 1,further comprising: an area partition block configured to partition aninput image into areas related with the plurality of objects on thebasis of color boundary.
 9. The image processing apparatus according toclaim 1, wherein the object area information is indicative of an arearelated with the plurality of objects in the image partitioned by colorboundary.
 10. The image processing apparatus according to claim 1,wherein the designated focus position information is indicative of aposition of a point included in a local focus area selected in theimage.
 11. An image processing method comprising: executing, by an imageprocessing apparatus, processing related with focusing on the basis ofobject area information indicative of an area corresponding to aplurality of objects in an image and designated focus positioninformation indicative of a designated focus position in the image.